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1 Introduction 



JTF Page Fabrication service speeds up page delivery for JSP applications. 



tl^^lS^^ DeSign SpeCifiCati0 " h3VC read - d « f-iliar-with the eContents of the 
<ProjectName> Functional Specification, Version x.y( [ <Project Name> FS ] ) 
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High Level Design 



The key idea behind page prefabrication is to create and store the http b« 

priori, so that when an user actually requests ; tteroi » «£T HTTP Response for a URL request a 
stored on the file system. Following S ™* ™*o»e is 

prefabricator. Figure 1 shows thfcase ST* 5? • ^ dc P** n « lt **egfcs for the 
^°-*ecaseXnth^ 

requu-es to both issue prefetch requests and acuiallv ™«. T " ! ' Case ' fce P refab ™ator 
response. In the latter case, the piSS^SST^ f ^ ^ ° f 1,16 P refetehed 

Calypso handles the cache ***** l-*** requests and 
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Figure 1: Prefabricator with Jserv 
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Figure 2: Prefabricator with Calypso 



The three main components: 

Prefabricator : this intelligently collects/generates all the URLs to be prefabricated and issues the imr 

prefabricated data. More details about this component follow. - 

ter^n this intercepts the URL requests, determines if the request can be serviced from the cache or 

Cache: this is responsible for storage and retrieval of prefetched responses 

The primary focus of this project is to build the prefabricator and interceptor technology Exist™ cachine 
tecrmologies (such as Calypso) will be leveraged for the cache component. Foilowmg^ubsSZlS 
the above three components in more details. auosecnons explain 
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Start Loader 



'generate home page 
URU 

•generate user-defined 
URLs 



{ Request Objects) 



Request Feeder 



•work queues for URL 
requests 
•process each queue (tern 



{ Request Objects) 



Benefit Analyzer 



•intervals to Issue requests: 
-resources 
• depth of tree 

- usage pattern 

- stateness 



Page Generator 



•send URL request to 
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URL Collector 



•crawl through URLs 
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Figure 3: Prefabricator Design 



^^i,?.* 10 * betwee * Afferent components of the Prefabricator. Hie basic unit of 

Common Data Structures: 

• PageRequestBIock class 

• Policylnfonnation class 

• SystemStatistics class 
Components 

• StartLoader 

• BenefitAnalyzer 

• RequestFeeder 

• PageGenerator 

• LfRLCoIlector 

• Invalidator 
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3.1 Prefabricator Data Structures 
3.1.1 Page Request Block (PRB) 

, Every URL that is a candidate for prefabricate is represented as a page request block 

Sorition: aSiC pMs ^ W0lmd * e ^ ^n^'ates the following 



Attribute 


Data Type 


Description 


URI 


String 


URI that the request represents . 


userlD 


int 


userlD of the user this request belongs to 


appID 


int 


appID this request belongs to 


respID 


int 


respID of the user this request belongs to 


depth 


int 


starting from the home page, the number of pages to be 
navigated before this URL is reached. A page is at depth 0 if 
it is the user's homepage, depth I if it is a page that can be 
reached directly from the home page, etc. Login page is at 
depth -I. 


Weighty 


long 


weight associated with this PRB 


homePRB . 


PRB 


PRB of the entry page to this application for the user 


file^ocator 


String 


location of the fabricated page on the file system 


requestTimeStamp 


Date 


time stamp when request block was created 


responseTimeStarap 


Date 


time stamp when page was fabricated 



All of the above mentioned attributes will have get and set methods. Following is the list of constructors for 
tnis object: 

1 . PageRequestBIock(String URI, int depth): assumes that this PRB is the first PRB 

2. PageRequestBIc^String URI, int depth, PageRequestBlock originator): assumes this PRB inherits 
userlD, appID and respID values from originator 

3. PageRequestBlock(String URI, int userlD, int appoint respID, int depth, PageRequestBlock home) 

Who construct PRBs? 

1. startLoader constructs entry point PRBs (uses constructor 1) 

2. URLCoUector constructs PRBs from a given PRB response stream (uses constructor 2) 

3. BenefltAnalyzer modifies PRBs to set the weight and requestTimeStamp attributes 

4. PageGenerator modifies PRBs to set the responseTimeStamp attributes 

3.1,2 Policy T^le ^f) 

The Policy 'Tabie stores tftformcaion to time the prefabricator ^ 

Admftistrarors will configure the policies using the Admin Console. The policies are striped by 
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application and persisted in the database When th* nr^u.™^ • * - , 

The policies supported by the policy table are: 

• ESfith: defines how deep down from the home page is candidate for fabrication 

• CPU consum ptio n lim it: the maximum CPU power available for the prerabricator 

• ££2Eon5ibJIiti« r 

• Afresh interval : defines how often a page should be re-fabricated ■ 
The following table is an example of the policy table 



•s 



App ID 


Depth 


CPU consumption limit 


Responsibility 


Refresh interval (sec) 


690 


2 


60% 


Managers, 
Representatives 


3600 


670 


1 


6m | Managers 


10800 



public int getDepthO 

public void setDepthfint depth) 

public int getCpuConsumptionLimitQ 

public voidsetCpuConsumptionlimitfim cpuConsumptionLimit) 

public Vector getResponsibilitiesO 

public boolean containsResponsibllityffnteger resp) 

public void addResponsibility(2nteger resp) 

public void removeResponsibility(Integer resp) 

public void removeAUResponsibilityO 

public Int getRefreshlntervalO 

public void setRefreshInterval(int refreshlnterval) 

public void loadQ; 

public void saveQ; 



3.1.3 System Statistics (ST) 

^emSlatisticspbje<^ 
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Attribute 


Data Type 


Description 


Depth 


int 


depth to which currently PRBs are processed 


FabricationRate 


int 


number of PRBs processed per minute "~ 


CPUUtilizdtion 


double 


the current CPU utilization 


JservCount 


int 


total number of Jservs available for processing prerabrication requests 

— — — — — i r 



AH of the above attributes have get and set methods to access them. 

3.1.4 User Page Table (UPT) 

•2£&™ r ^ ™ e ^ tmCk ° m ° rmation <*out prefabricated pages that the Benefit Analyzer 
Information store^ 

The User Page Table is a single column table with a list of Page Request Blocks. 



Page Request Block (PRE) 

The PRB contains information about a particular jsp page. It is populated by Start Loader, Benefit 
Analyzer arid Page Generator. 
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at a time or in batches. Nfo«d^ f 1 ™* * done 1 PRE 

APIs supported by the User^Sle A " B ** ar SeCti ° n ' Fo,Iowin e «■ list of 

void add(PageRequestBlock) 

PageRequestBlock removePRB(StringURI) 
void remove (PageRequestBlock) 

intsizeO * *■ 

Vector getAll 0 

Vector find (int userlD, int appID, int respID) • 
Vector find (String URISubString) 
PageRequestBlock find (String URI) 

Vector getPRBOrder By (DEPTH/WEIGHT, int count, ASC/DESC) 



Who populates this table? 



Components that would write to the User Page Table are: 
Start Loader 



are 



Page Generator 



KR£ Collector 



Given the URL of a prefabricated page from the Page Generator (assuming it is at level n) the URL 

0^5^ ^ ttle ; ,pre&b, / Cati0n ^ bte, ' URL-poases^ssible SS&JSLm 
page. This list of URL are used to populate the User Page Table. 



Who reads this table? 



Benefit Analyzer 



Data Structure Requirements 

The data, structure is still undecided But the requirements are as follows: 
Speed 
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Synchronization Needs 

Different threads may access the User Paee Tahl** «t ««w> »: j 
Method of Traversal 

fly Pfe/gAr 

The Benefit Analyzer needs to access all pages with a specified weight 
By User 

The Benefit Analyzer needs to access ail pages of a particular user. 
By URL 

to^f.! ^? y *f' needs to acces ? ■» P*S*s with a particular url portion. One example is that it needs 
to access all jsp's of the same name Qt&sud.jsp). 




• Another method of traversal that might be useful in the future would be to enable a user-defined 
key (e.g.respID) to scan the table and retrieve pages. user-oennea 

• Yet another possible method of traversal would be to scan the table by specifying the level the 
pages are at The usefulness of this feature is to be determined 8 



3.2 Start Loader 



This component does _the mrtial bootstrapping for the prefabricate* system. Given the home page (entry 
P?" SP**^^ component will generate all possible URL requests for the home page. The 
generated PRBs is populated .n ±e user page table so that the benefit analyzer can use it. 

Requirements 

no i mepa^e aPPMCati0n ' S ^ ( * ^ ™* geDCrate mLs for aU UMn who 03,1 access 

SKlw SiS? T° (a j ? P ^ ^ f° Vide mechaflism for ** application developer to generate 
valid URL requests for mis application page [Future] 



Implementation Details 

S^S^^JI 1 g ^ l, ^ CVa,Uati0,I ™c^*,*PKBt:yaluatel n terface is defined. A default 

°,f ™f. Jnferfece is provided to handle the >jme page" URL generation. Application 
developers can provide their own implementation of the interface Z support (^er application p^e URL 
gmeration.FolIow^^ vpucanon page UKL 
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getPRBsO: constructs a Vector of valid PRB objects ~ 
getParameterNamesO: returns a String an*y of URL parameter names that the page expects 

. pa^ P ^ Weready ' itinVOkeS ^ 

« Periodically, this thread wakes up to check if new ppr c MO(1 j + . . 

the case where new users registering Z system f ^ ™ s handl « 

The default implementer of the PRBEvaluatelnterface class does the following- 
construct a PRB object for each valid {userlD, appID, respID} combination 

3.3 Benefit Analyzer 

At any given point of time and state of the prefabricator system, Benefit Analyzer determines the next set 
Selection Algorithm 

As stated earlier, the primary goal of the algorithm is to detenninemenextsetof ppr^« «,u • * ^ 
"Estate of the system. The a^ 

At system start-up time, determine initial workload set 

Filter (or select) PRBs to be processed based on the current febrication rate of the system 

the algorithm should result in user home pages being always ranked the highest 
The algorithm uses the following information that is avaUable to ft at all times: 
all prefabricated pages (PRBs) 
policy information from the policy table 

stateness of home pages - indicated by the timestamp of the home page PRBs in the user page table 

The algorithm works as. follbws; * " 
A^^isadde**^ 

wight = (l/depth) + k 




where* . " ~ 

depth = depth of the PRB in the .tree, 

k = some constant to indicate the rekvance of the URL to the responsibilities in the policy table 

htgtel rutod Oiome page) PRB,, If home page PRTfc an, stale bayond mILplabL Sme Slfe. 
mates sore all the home pages gel generated at regular intervals. 

Implementation Details 

^m eneflt ""^ Pf0VideS f ° Il0Wing SCrviceS t0 be ^ diffe ™< components within the 
Adding PRBs to be prefabricated into the user page table; 
addPRBCpageRequestBlock, timeStamp) 
addPRB(pageRequestBlock) 

addPRB(Vector pageRequestBlocks, Vector timeStamps) 

addPRB(Vector pageRequestB locks) 

PRBFiher: 

getPRBsO: returns a Vector of PRBs to be processed in a queue. This implements the selection algorithm 
^ e r ^ g S | cmentMe ^ featchSize): returns a Vector of next set of PRBs to be processed (works like a 

isPMInterestuig(PRB): returns a boolean to indicate if PRB should be considered for further processing 

, The benefit analyzer executes as a thread that periodically wakes up, selects PRBs to be processed and 
issues these to the "Request Feeder". . ■ w w P iw«sea ana 

Future & Open Issues 

SdffS-il^^.^ l * m0K fme " tUned - 0116 0pti0n * t0 ^ fa ** fanout «-octatod with URLs 

K'^ f . h 0f " n U if jn the wcightfonnula: » =p*(l,depth) + i LLcr option is to 
fector in user hit counts, in the weight formula, 

finalize the APIs associated with this component 

3,4 Request Feeder 

Request Feeder performs the page generation from the Page Request Blocks. 
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Algorithm: 

The Request Feeder (RF) maintains two internal < 



The elements in the queue are PRB'sV " queues (I) The incoming queue. (2) The outoing queue. 

^B^analyzerputsPRB'smmeincomingqueueforpagegeneration. 

The Request Feeder update the generated time in the PRB. 
. The Request Feeder updates the current page generation rate for the PRB in the SystemStats object 
The generated PRB is put in the outgoing queue. The URL collector picks up the PRB. 

Openi 

Whether or not the PRF saves the HTML response as a file on the file system or the interceptor does it. 

Data Structure; 



queue is the Page Request Block. 



I as a vector. The element type of the 



API's; 

QueneManager; 

public interface QueueManager 
f 

public static final int LOW = 0; 
public static final int MEDIUM = 1; 
public static final int HIGH = 2; 

* returns the next QueueElement. The next QueueElement is chosen from 

* amongst the three Queues. The weight of each element is a function of 

* the time spent in the queue and the priority of the queue it is in. The 

* element returned is removed from the corresponding queue. 
* 1 ©return the next QueueElement 

* ©exception orade,appsjtf.base.resources.Fram if 



an error occurs 



public QueueElement getNextElementO 

throws FrameworkExceptioh; 
/** 

• returns the next QueueElement. The next QueueElement is chosen from 

Oracle Confidential 
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* amongst the three Queues. The weight of each element is a function of 

* the time spent in the queue and the priority of the queue it is in The 

* element returned is NOT removed from the corresponding queue. 

* @return the next QueueElement 

* ©exception oracleMppsMbase.resources.Framework^ception if an error occurs 
V 

public QueueElement peekNextElementQ 

throws FrameworkException; 
/** 

* returns the next QueueElement from the specified queue. The 

* element returned is MOT removed from the corresponding queue. 
*@param priority the priority of the queue. 

* @return the next QueueElement 

* ©exception oracleappsjtfbase.resourc^ ifan errQr QCCUfS 
V 

public QueueElement peekNextElement(int priority) 

throws FrameworkException; 
/*♦ 

* adds a QueueElement to the specified queue. 

* ©param elem the QueueElement to be added. 

* @param priority the priority of the queue. 

* ©return the added element 

* ©exception oradeMpps4tf.base,resources.Frameworl^ception ifan error occurs 
V 

public QueueElement addToQueuefObject elem, int priority) 

throws FrameworkException; 
/**"'■" 

* removes a QueueElement from any queue in which it is found 

* @param elem the QueueElement to be added 

* @param priority the priority of the queue. 

* ©return the removed QueueElement 

* ©exception oracteMppsjtf.baseresour^ if an occurs 
V 

public QueueElement removeFromQueue(Object elem) 

throws FrameworkException; 
/** 

* removes a QueueElement from specified queue 

Oracle Confidential 
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*@Paramelem the QueueElement to be added 
*@i>aram priority the priority of the queue. 
* ©return the removed QueueElement 

public QueueElement removeFromQueuefObjectelem, im priorjty) 

throws FrameworkException; 
/** 

* removes the top from specified queue, , 

* @param priority the.priority of the queue. 

* ©return the removed QueueElement 

* ©exception oracle.appsjf.t^^ ^ ^ ^ 

public QueueElement removeFromQueuefint priority) 

throws FrameworkException; 
/*♦ 

* tells whether or not all the queues are empty 

* return true if all the queues are empty, false otherwise 

* ©exception oracleappsMbase.resources.Fram^ ifan errQr ^ 

public boolean IsEmptyQ 

throws FrameworkException; 
/** 

* tells whether or not the specified queue is empty 

* @param priority the queue priority 
■* return true if the specified 'queue is empty, false otherwise 
*®™<*P<™oraclzappsJtf^^ 
V 

public boolean isEmpty(int priority) 

throws FrameworkException; 
/*♦ 

* tells whether or not all the queues are full 

* return true if all the queues are fall, false otherwise 

* ©exception oracleappsMbaseresources^^ V<m m 
V 

public boolean IsFuIlQ 
ArowsFrameworkException; 

Oracle Confidential „ , 

Version*. 



' Design Specification] 



* tells whether or not the specified queue is full 

* @param priority the queue priority 

* return true if the specified queue is full, false otherwise 

* ©exception oracle^ppsftf base, resources. FrameworkException if an error occurs 
V 

public boolean isFull(int priority) 
throws FrameworkException; 

* returns the size of the specified queue 

* @param priority the queue priority 

* ©return the number of elements in the queue 

* ©exception oracle. appsJtfbase.resources. FrameworkException if an error occurs 
*/ 

public int getQueueSizefint priority) 

throws FrameworkException; 
/** . 

* returns the total size of all the queue 

* ©return the number of elements in the queue 

* ©exception oracleMppsftf.baseresomces.Framewormception if an error occurs 
V 

public int getQueueSizeO 

throws FrameworkException; 
/** 

* returns the maximum queue size allowed for a-queue 

* ©param priority the priority of the queue 

* ©return the maximum queue size allowed 

* ©exception orade.appsjtf.base.resowces.Fram^ if an error occurs 
V 

public int getMaxQueueSize(int priority) 

throws FrameworkException; 
/** 

* returns the maximum queue size allowed for all the queues 

* ©return the maximum queue size allowed 
©exception orade.appsjtf.base.res<mrces.Fra^^ ifan error occurs 



*/ 

public int getMaxQueueSizeQ 
Version; Oracle Confidential 
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throws FrameworkException; - - 

/♦♦ 

* set the maximum queue size of the given queue 

* @param priority the priority of the queue 

^exception oracl,apps Mbas ^ 0 „ c ^ ^ ^ ^ 

public void setMaxQueueSize(int priority) 
throws FrameworkException; 



} 



QueueElement: 

public class QueueElement { 

private Object element j 
private int prior ityj 
private long timestampj 

public QueueElement(Object element, int priority); 

public Object getBlement0; 
public int calculateRankQ; 

public int compare(QueueElement qe); 

} 



PageRequestFeeder: 

public class PageRequestFeeder 
{ 

public PRE getElementO 
throws FrameworkException; 
public boolean putElemeht(PRB pr) 
throws FrameworkException; 
public boolean generatePRB(PRB pr) 
throws FrameworkException; 
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public float getPRBRateO 
throws FrameworkException; 



} 



3.5 URL Collector 



HTML Pages 



> 


Crawler 






— ► 











Valid URIs 



Repository 



I^ISSS 6 Pf^f* °( dupHcates/cireuIar-references the URL Collector will generate and store a unique Hashld for 
The same unique Hashld will also be used by the Interceptor for looking up cached pre -febricated pages. 

3.6 Page Generator 

p?ShS^^ 



3.7 Bage In validator 

P^ 06 ^P?? of invalidation schemes are supported: 
,« interv al-based invalidation: requests for re-generating a particular URL are issued at regular intervals. The 
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following i^ormatlon: '" Val " im ™ ■*"* *« Wliclmn developer would have to „^ r „,„ 

• to of BP pag^; jsp p. gc ^ URL pa™.,** (if „ y) „», ^ it 

be invalidated. *' ' S ° SelKd b >"" P"»" forlhfe should 



- more details on this issue are addressed in the following interceptor section 

- if Calypso is used, it would handle this 

2 ' w'lT ^ ™ alidation ' to interceptor has to communicate to the invalidator 

- more details on this issue are addressed in the following interceptor section 



3,8 User Session Management 

User session management has to be done at two levels: 

• ^Prefcbricatorissu*^ 

• user tractions 

TWs section describes how the above two cases areiaiirii^ i„ 0 ^ 

replaced the xiona&\jtfavcdd.jsp. It does the foDowing: JWejao.jsp. im&page 

1. Takes userlD, appID and respID as inputs 

2. Authenticates a special prefabUser 

3. Switches user session context to that specified by userlD - invokes setUser 

Mn.n >pr "jW* is «»H the interceptor set, the user', sesaiorJD to be lbs «™ as that cn-tri &, 
aS^SS^^ 

3.9 Interceptor 

tTiis component intercepts the URL requests, determines if the request can be serviced from me cache or 



not The basic algorithm implemented by the interceptor is as follows: 
Check if request is from prefebricator or from 
If from user: 



user (by examining a parameter in the request object): 



If not present in cache, s 



srvice the page 



If from spider: 
Service the page 
Store response in the cache 
In either case, response should also be T-d to the URL Collector component of the prefebricator. 

Open Issues 

How efficiently can the response-T be implemented? 

SSSd?"" mUltiPlC aPaChe ^ d0eS Synchronization of Validation information get 

- could range-partition requests by userlD across different apache hosts. This will maintain user-level strict 

SET* m 1 &Ct0SS muWple E * : 80168 putative a reptt, 

manager would want to see it But how much strict consistency is actually deeded? 5 

Mtiun a single apache host, how does synchronization of invalidation information across multiple Jservs 

* if implemented in C, can use shared-memory 

^ 0 ^; load : baIancin g ,, ^orithm into apache, so that requests from a range of users is always 
sent to a specific Jserv. i.e., range-partition by userlD across Jservs y 



Need clear design of ssoCookie update mechanism 



3.10 Cache 



The cache provider needs to support the following: 
store response in the cache based on a key 
get response from the cache based on a key 

^S^SSt^i^ bk *" S6rVer ° n - dCmand CP"^ nccd «» Calypso which is a 

S^^ P ° n f ri ° bjeCt ^ ! DterCe i' t0r specified ^"nation (««* as cookies) if the cache Is handling 
the returning of the response (specifically needed from Calypso which is a cache and reverse-proxy) 

Open Issues: Calypso Requirements 

pass-through to service the request, rather than using the cache 

modifj«esponseHeader(„) - abflity to modify the response header before sending to client 
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SSSSSSZ wiS: 3 C ° I,eCti0n ° (inU> ™ 1 ^ ** Sh0uld a » b < «<- (reference the 



(i the number of round trips f 

- a description of what the function does 

- the input and output parameters and descriptions . ' 

Pass by re£ value, pointers 
n null pointers expected to be initialized, or Ok to return empty 
■ memory allocation/deallocation, e.g. if client allocates, they deallocate 

If the product includes classes, it should include similar information about the classes, how they relate to 
each other (preferably with a class hierarchy diagram), and ail of the attributes and t^^jS^ 
Similar information is to be provided for QCI, PRO, and Java interfaces. 




B Glossary 



If your project uses a lot of terminology that may be new to your reviewers vou should ™ -a aa- 
glossary sect™. Otherwise, just describe it in the Concepts LtioT ^ ' 



<term> 

<definition> 

Examples: 



Gizmo 

A peculiar construct. 



Widget 

A widget is an instance of a gizmo. 
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